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A geometric approach to differential Hamiltonian systems and 

differential Riccati equations 

Arjan van der Schaft 


Abstract — Motivated by research on contraction analysis and 
incremental stability/stablllzability the stndy of ’differential 
properties’ has attracted increasing attention lately. Previously 
lifts of functions and vector fields to the tangent bundle of 
the state space manifold have been employed for a geometric 
approach to differential passivity and dlssipativity. In the same 
vein, the present paper aims at a geometric underpinning and 
elucidation of recent work on ’control contraction metrics’ and 
’generalized differential Riccati equations’. 

I. Introduction 

This paper provides a geometric counterpart to recent work 
on differential versions of Hamiltonian matrices and Riccati 
equations, motivated by incremental stability analysis and 
incremental stabilizability (cf., [18], [22], [12], [9], [10]). 
While in most of this work either coordinate expressions are 
used (see, e.g., [19], [20]), or an algebraic point of view 
is adopted (see in particular [13], [14], [11], motivated by, 
e.g., [17], [15], [16]), the current paper provides a geometric, 
coordinate-free, description based on the geometric theory of 
liftings of functions and vector fields on manifolds to their 
tangent and cotangent bundle as detailed in [26]; see also 
[5], [3], [25]. 

Such a geometric approach may provide additional in¬ 
sights, and may yield elegant proofs for statements which 
otherwise require cumbersome coordinate computations that 
are only locally valid. Furthermore, a geometric approach 
can address global problems. It was explored before in the 
study of differential passivity and dissipativity in [25]. 

II. Preliminaries 

A. Basic notions 

Throughout this paper all objects (manifolds, functions, 
vector fields, one-forms, (co-)distributions, subbundles, ..) 
will be assumed to be smooth (infinitely differentiable). 

Consider an n-dimensional state space manifold X with 
tangent bundle TX and co-tangent bundle T*X. Consider 
furthermore a vector field / on X, that is, a smooth section 
of TX. A distribution D on X (a subbundle of TX) is 
called invariant [21] with respect to / if LfD C D, that 
is LfX G D for any vector field X in D. Here Lf denotes 
Lie derivative with respect to /; i.e., LfX = [f,X]. 

In particular, the one-dimensional distribution spanned by 
a vector field A on A is called invariant with respect to / 
if there exists a function 7 on A such that 

LfX = jX (1) 
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In local coordinates x = (a;^, • • • , x”) for A and writing / 
and X as column vectors this amounts to the equality 

y^{x)X{x)-^{x)f{x) =--i{x)X{x) (2) 

(In [13] this is expressed algebraically by saying that X is 
a right eigenvector for §j(a;) with eigenvalue 7 .) Similarly 
[21], a co-distribution P on A (a subbundle of T* A) is called 
invariant if LfP C P, that is, Lja € P for any one-form 
a on A (a one-form on A is a smooth section of T*X). In 
particular, the one-dimensional co-distribution spanned by a 
one-form a is said to be invariant with respect to / if there 
exists a function 7 on A such that 


Lfa = ja 


(3) 


In local coordinates x, and expressing a as column vector, 
this amounts to the equalit }0 

^ 7(a:)a'^(J (4) 

(In [13] this is expressed by saying that a is a left eigenvector 
for ^(x) with eigenvalue 7 .) 


B. Lifts of functions and vector fields to the tangent and 
cotangent bundle 


In this subsection it is recalled from [26] (see also [5],[3]), 
how functions and vector fields on the state space manifold 
A can be lifted to functions, respectively vector fields, on 
its tangent and cotangent bundle. 

First we introduce the notions of complete and vertical 
lifts of functions and vector fields to the tangent bundle. 

Given a function h on A, the complete lift of h to TX, 
hf : TA ^ R, is defined by hf{x,5x) = {dh,dx)(x), with 
(•,•) denoting the duality pairing between elements of the 
co-tangent space and the tangent space at a; G A. In local 
coordinates x = {x^,... ,a:") for A and the induced local 
coordinates {x,6x) = (a;^,..., x", ..., fe") for TX 

this reads 


h-ix,dx) = )^—{x)dx, 

a—1 


(5) 


The vertical lift of a function h to a function on TX, hf : 
TA —>■ R, is defined by hf{x,5x) = ho tx, where tx '. 
TX ^ X denotes the tangent bundle projection tx {x, 6x) = 
X. In local induced coordinates hf{x,5x) = h{x). 

Given a vector field / on A, the complete lift of / to 
TA is defined as the unique vector field satisying Lfch’^ = 


*Use the magical formula Lfa = Lfda d(a(f)). 


{LfhY, for any function h on X (with Lfh denoting the 
Lie-derivative of the function h along the vector field /, 
and similarly for Lfch^). Alternatively, if ^ ^ X, 
t S [0, e), denotes the flow of /, then /'^ is the vector field 
whose flow is given by ($t)* : TX TX. In induced local 
coordinates (a:^,..., a:", Sx ^,..., 6x^) for TX, 

^ ^ -p 

/'(*•**) = «*> 

a=l a,6=1 ' ' 

Finally, the vertical lift p of f to TX is the unique vector 
field on TX such that Lphf = {Lfhy, for any function h. 
In induced local coordinates for TX 

a 

r(a:,fe) = ^/a(x)^^ (7) 

a—1 '' ^ 


Furthermore, the vertical and Hamiltonian lifts to the co¬ 
tangent bundle are defined as follows; see again [26]. As 
before for the tangent bundle case, the vertical lift IX : 
T*X R of a function /i : ^ R, is defined by 

IX = h o Ttx, where : T*X ^ X denotes the co¬ 
tangent bundle projection Trx{x,p) = x. In induced local 
coordinates {x,p) := ..., ... ,p„) for T*A’ we 

have IX {x,p) = h{x). 

Since there is a natural symplectic form on the cotangent 
bundle T*X we can define the Hamiltonian vector field on 
T*X corresponding to IX, denoted by and called the 
vertical Hamiltonian lift. In induced local coordinates {x,p) 
for T*X 


Xh'' 


^ dxa ^ d(j}°-) 


(8) 


Furthermore, for any vector field f on X define the Hamil¬ 
tonian function H^ : T* X ^ R as 

H^{x,p) = {p, f{x)) = p^f{x) (9) 


The corresponding Hamiltonian vector field on T*X, de¬ 
noted by Xjjf, is called the complete Hamiltonian lift. In 
induced local coordinates for T*X 


Xnf = ^fa{x) 

a—1 


d 

dx°- 




a,h—l 


d 

d{Pa) 


( 10 ) 


For later use we mention that given a lift (complete or 
vertical) of a vector field / to the tangent bundle, as well 
as a lift (Hamiltonian or vertical) to the co-tangent bundle, 
we can combine the two lifts into a vector field defined on 
the Whitney sum TX (BT*X (that is, the base manifold X 
together with the fiber space PX x T*X at any point x € 
X). An example (to be used later on) is the combination of 
the complete lift p on TX with the Hamiltonian extension 
Xfjf on T*X, which defines a vector field on TX (B T* X, 
which will be denoted as p (B Xfjf. Furthermore, since the 
vertical lifts p (to TX) and Xh-^ (to T*X) do not have 
components on the base manifold X we may also define 
the combined vector field p © Xh'/ on the Whitney sum 
TX (BT*X for any vector field / and function h. 


C. Prolongation of nonlinear control systems to the tangent 
and the co-tangent bundle 

Armed with the notions of the lifts of functions and vector 
fields to tangent and cotangent bundle as described in the 
previous subsection, we now recall from [5], see also [3], 
[25], how we can define prolongations of nonlinear control 
systems to tangent and cotangent bundles. 

Consider a nonlinear control system E with state space X, 
affine in the inputs u, and with an equal number of outputs 
y, given as 


X = f{x)+J2uj9jix) 

yj = hj{x), j = l,.... 


( 11 ) 


m, 


where x € X, and u = (ui,..., Um) <Z R™. The set 14 
is the input space, which is assumed to be an open subset of 
R™. Finally, y — R™ is the output space. 

The prolongation of the nonlinear control system to the 
tangent bundle and the cotangent bundle is constructed as 
follows; cf. [5]. 

Given an initial state a;(0) = xq, take any coordinate 
neighborhood of X containing xq. Let t G [0,T] x{t) be 
the solution of (ITTl i corresponding to the admissible input 
function t G [0,T] ^ u{t) = .. . ,Um{t)) and 

the initial state x(0) = xq, such that x{t) remains within 
the selected coordinate neighborhood. Denote the resulting 
output by t G [0,r] 1 -^ y{f) = {yi(t),... ,ym(t)), with 
yj{t) = Hj(x{f)). Then the variational system along the 
input-state-output trajectory t G [0,T] {x{t),u{t),y{t)) 

is given by the following time-varying system 


= %ixit))Sx(t)-B 

ET=i (^)^ {x{t))Sx{t)-B 

j = 1,... 


( 12 ) 


Syjit) = 


^{x{t))5x{f), 


m , 


with state 5x{f) G T*^^s^X, where Su = {Sui,... ,Sum)'^, 
6y = {Syi,... ,5ym)'^ denote the input and output vectors 
of the variational system. (Note that ^f-{x) denotes a row 
vector.) 

The reason behind the terminology ‘variational’ comes 
from the following fact: let (x(<, e), e), y(f, e)), t G 

[0,T], be a family of input-state-output trajectories of (ITTl i 
parameterized by e G {—S, <5), with x{t, 0) = x{t), u{t, 0) = 
u{t) and y(t,0) = y{f), t G [0,T]. Then, the infinitesimal 
variations 


3x 

5x{t) =—{fff), 


6u{t) = , 


^y{t) = > 


satisfy equation 

Remark 2.1: For a linear system x = Ax + Bu, y = Cx 
the variational systems along any trajectory are simply given 
as 5x = A5x + B6u, Sy = C6x. 

The prolongation (or prolonged system) of comprises 
the original system together with its variational systems. 






that is the total system 


X = fix) +T,T=i^j9j{x) 

^xit) = ^ix{t))Sx{t) + 

ET=iS^jit)9Mt)) 

Vj = hjix), j = l,...,m 

^Vji*) = ^ixit))5x{t), 3 = 1 ,...,, 

with inputs uj, 5uj, outputs yj, 5yj,j = 1, • • • ,m, and state 
vector X, Sx. 

Using the previous subsection the prolonged system (fOT l 
on the tangent space TX can be defined in the following 
coordinate-free way. Denote the elements of T<Y by x; = 
ix,5x), where tx{xi) = x £ X with tx ■ TX —5> X again 
the tangent bundle projection. 

Definition 2.2: [5] The prolonged system ST of a nonlin¬ 
ear system S of the form (fTTT l is defined as the system 


' m m 

xi = fixi) + '^Ujgij{xi) -\-'^Sujg]ixi) 

xy . i=i i=i 

y 3 =h]ixi), j = l,...,m 

^y 3 =hijixi), j = l,...,m 

(14) 

with state xi = {x,5x) £ TX, inputs Uj,6uj and outputs 

j = 1,... ,m. 

Note that the prolonged system ST has state space TX, input 
space T14 and output space Ty. One can easily check that 
in any system of local coordinates x for X and the induced 
local coordinates x,Sx for TX, the local expression of the 
system (fT4l) equals (fTJl l. 

Remark 2.3: For a linear system x = Ax + Bu, y = Cx 
the prolonged system is simply the product of the system 
with the copy system Sx = ASx + BSu, Sy = CSx. 

The prolongation of the nonlinear control system T to 
the co-tangent bundle is defined as follows. Associated to 
the variational system (fT^ there is the adjoint variational 
system, defined as 

fW = -i^)^ix{t))pit) 

-j:T=iMt)i^)^ixit))Pit) 

dyjit) = p^gjixif)), j = l,...,m, 

with state variables p £ Tff.^.jX, and adjoint variational 
inputs and outputs duj, dyj,j = 1,... ,m. 

Then the original nonlinear system S together with all it 


adjoint variational systems defines the total system 

X = fix)-^J2"liUjgj{x) 

pit) = -i^)^ixit))pit) 

-Y.7=i^At)iWixit))pit) 

-jy7=idujit)^ixit)) 
yj = hjix), j = 

dyj it) = p'^g, ixit)), j = l,...,m. 


with inputs uj, duj, outputs yj, dyj,j = 1 , • • ■ ,m, and state 
x, p. This total system is called the Hamiltonian extension. In 
a coordinate-free way the Hamiltonian extension is defined 
as follows. 

Definition 2.4: [5] The Hamiltonian extension dT of a 
nonlinear system S of the form (fTTT l is defined as the system 


Xe — 


dT : 


yj 

dyj 


Xr! iXe) + iXe) + 

TJ7=ldUjX^iXe) 
h'jiXe), j = l,...,m 
HSi{Xe), j = l,...,m 


(17) 


with state Xe = ix,p) £ T*X, inputs Uj,duj and outputs 
yj^dyj, j = l,...,m. 

Note that the Hamiltonian extension dT has state space T*X, 
input space T*IA and output space T*y. 

Remark 2.5: For a linear system x = Ax -\- Bu, y = Cx 
the Hamiltonian extension is simply the product of the 
system with its adjoint system p = —A^p — C^’^du, dy = 
B^p. 

Remark 2.6: The prolongation ST of E to the tangent 
bundle can be combined with the Hamiltonian extension dT 
of T to the co-tangent bundle. This will define a system on 
the Whitney sum TX (BT*X with inputs u,Su,du, states 
X, Sx,p and outputs y, Sy, dy. 


III. Invariant subbundles 

Let as before X denote the n-dimensional state space man¬ 
ifold. Consider the Whitney sum TX ®T*X (as explained 
before, the base manifold X together with the fiber space 
TxX X TfX at any point x £ X). 

Definition 3.1: A subbundle K of TX (BT*X is a vector 
bundle over X with fiber Kix) C T^X xTfX at any point 
X £ X. The subbundle K is called invariant with respect to 
a vector field / on A" if 

iLfX,Lfa) £ K for any (AT, a) S K (18) 

Remark 3.2: If K has only zero components in TfX for 
any point x £ X, then K can be identified with a distribution 
on X. Alternatively, if K has only zero components in T^X 
for any point x £ X, then it can be regarded as a co¬ 
distribution on X. In these cases invariance of K with respect 
to / amounts to invariance of the associated distribution, 
respectively, co-distribution, with respect to /. 

Remark 3.3: The above definition of invariance of K 
is formally identical to the definition of an infinitesimal 








symmetry of a Dirac structure', see [4], [7], [24] for details. 
(A Dirac structure is a subbundle of TX (B T*X which is 
maximally isotropic with respect to the duality product.) 

Associated to the subbundle K we can define the subman¬ 
ifold 1C of TX ® T*X as follows 

K. := {(cc, 6x,p) & TX® T*X \ (5x,p) G K{x)] (19) 

We have the following useful characterization of invariance 
of invariance of K. First, recall from the previous section that 
we may lift the vector field / to the vector field on TX 
(the complete lift), as well as to the vector field Xfjf on T*X 
(the complete Hamiltonian lift). Taken together this results 
in a lift to a vector field on the Whitney sum TX ®T*X, 
denoted as 

f®XHf ( 20 ) 


Proposition 3.4: The subbundle K is invariant with re¬ 
spect to the vector field / on <T if and only if the submanifold 
K, is invariant for the vector field © Xfjf- 

Proof: In coordinates x and induced local coordinates 
for TX and T*X the vector field © Xfjs at a point 
{x, X{x),a{x)) € K. CTX (B T*X is given by 


fix) 


fix) 

Uix)Xix) 

L-(g)^(x)a(x)J 

— 

^ix)fix) - LfX{x) 
Mix)fix)) -Lfa{x)_ 


0 

LfX{x) , 
Lfa{x)_ 

where the first vector in the last term denotes a tangent vector 
to fC. Thus if (ITsT l holds then the vector field © X^jf is 
tangent to 1C. Conversely, if is tangent to 1C then 

this implies that the second vector in the last term is tangent 
to 1C for all {X{x),a{x)) G K(x), which amounts to ( [TsT l. 
i.e., invariance of K. ■ 


fix) 

.hix)fix). 


IV. Differential Hamiltonian systems 


It is well-known, see, e.g., [23], that the Hamiltonian 
equations arising from applying Pontryagin’s Maximum prin¬ 
ciple to the optimal control problem of minimizing the cost 
criterion 

1 r°° 

2 Jo 

for the nonlinear control system S are given by the following 
system on T*X 


X 

P 




dp 

^T^opt 


dx 


( 22 ) 


with the Hamiltonian iJ°P* :T*X —> K given by 

H°P\x,p) =p'^f{x) - ^p'^g{x)g'^{x)p B- {x)h{x), 

(23) 

where g has columns gi,... g-m and h : X ^ K™ has 
components hi,..., hm- 


Motivated by [14] we will study the differential version 
of the Hamiltonian system (i22l i. In the next section we will 
apply this to the differential version of the Hamilton-Jacobi 
equation corresponding to (l22l i. called a differential Riccati 
equation in [14]. 

In order to motivate the subsequent developments, let us 
first recall from e.g. [23], see also [5], that in the linear case 
the Hamiltonian system (i22T l on T*X can be obtained from 
interconnecting the linear system x = Ax + Bu, y = Cx 
with the adjoint system p = —A'^p — C^du, dy = B"^p, by 
the interconnection equations 

u = —dy, du = y, 

leading to the linear Hamiltonian system 


X 


A 

-BB'^' 


X 

A 


_-C^C 



P. 


Similarly, we will now define a differential Hamiltonian 
system by considering the interconnection of the prolongation 
ST given in (lOT l and the Hamiltonian extension dT in (O, 
via the interconnection equations on the (adjoint) variational 
inputs and outputs 

Su = —dy, du = Sy 

It can be directly verified from the definition of the pro¬ 
longation 5T and the Hamiltonian extension dT that this 
defines a system on the Whitney sum TX (BT*X which in 
a coordinate-free fashion is given as 

z = f^ IB Xnf iz) - YfjLi H^^g] © {z) 

+ ® XfjOj {z) 

Vj = hj{x), j = l,...,m, 

(25) 

with total state z := {x,Sx,p), and with remaining inputs 
and outputs Uj,yj,j = l,...,m. Note that pj © is 
the vector field on the Whitney sum TX BT*X obtained 
from combining the vector field g'- on TX with the vector 
field X^p on T*X. The system ( 12^ is called the differential 
Hamiltonian sysfeiiQ 

Similarly to what we did before for invariance with respect 
to © Xjjf we can define invariance of subbundles with 
respect to the differential Hamiltonian system (i25l l. 

Definition 4.1: Consider the differential Hamiltonian sys¬ 
tem (i25l l on the Whitney sum TXBT*X. A subbundle K of 
TXbT*X with its associated submanifold 1C C TXbT*X 
is invariant with respect to (i25l l if 

m m 

f'^ © Xfjf — g'^ © hfjX^ + Ujg'^ © X^sj ( 26 ) 

i=i " 

is tangent to X for all Uj, j = 1,... ,m. 

The following proposition is immediate. 

Proposition 4.2: A subbundle K of TX © T*X with its 
associated submanifold /C C TX © T*X is called invariant 

^Note however that the system E) by itself is not Hamiltonian in an 
ordinary sense. However it can be interpreted as a linear Hamiltonian system 
along trajectories of E. 


















with respect to ( l25l l if and only if 

(1) © x^f - is tangent to /C, 

(2) K is invariant for gj,j = 1,... ,m. 

V. Invariant Lagrangian subbundles and 

DIFFERENTIAL RiCCATI EQUATIONS 

Associated to the optimal control problem (| 2 TI) and the 
resulting Hamiltonian system (|22]) there is the Hamilton- 
Jacobi-Bellman equation 

+ {x)h{x) = 0 

Under appropriate conditions, the positive solution to the 
Hamilton-Jacobi equation is the value function P : X —>■ M. 
of the optimal control problem, that is, P{x) is the minimal 
cost for the system starting at time 0 at initial state x. 
Furthermore, the optimal control is given in feedback form 
as M = -g'^{x)^{x), while the Lagrangian submanifold 
N := {{x,p) e T*X I p = ^^{x)}, see e.g. [1], equals 
the stable invariant manifold of the Hamiltonian system (|22]) . 
cf. [23]. In the linear case x = Ax + Bu,y = Cx the 
Hamilton-Jacobi equation (l27l i reduces to the well-known 
Riccati equation 

A^P XPA- PBB'^P + C^C = 0, (28) 

whose positive solution P yields the quadratic value function 
P{x) = ^x"^Px, and is such that the Lagrangian subspace 
{{x,p) \ p = Px} is the generalized eigenspace correspond¬ 
ing to the n eigenvalues in the left-half of the complex plane 
(assuming, e.g., minimality of {A, B, C)). 

Recently in [14], motivated in particular by developments 
in [19], [20], the differential version of the Hamilton-Jacobi 
equation (iZTi l was introduced, called a (generalized) differ¬ 
ential Riccati equation. In this section we will approach this 
from a coordinate-free point of view, using the machinery 
built up in the previous sections. 

In order to do so we will define a special type of subbundle 
of the Whitney sum TX © T*X. 

Definition 5.1: A subbundle K of TX (B T* X is called 
a Lagrangian subbundle if K{x) C T^X x T*X is a La¬ 
grangian subspace (with respect to the canonical symplectic 
form on T^X xT*X [1]) for every x G X. 

Example 5.2: All subbundles K with K(x) = {{5x,p) \ 
p = n(a::)fe}, where n(a;) is a symmetric matrix, are 
Lagrangian. More generally, all subbundles 

K{x) = {(5x,p) I V{x)p = U(x)5x, 


with a{x) = ^^{x)X{x), where X{x) G T^X and a{x) G 
TpT* X, and with (x) denoting the Hessian matrix of P. 
Identifying TpT*X with T*X (well-defined since T*X is a 
linear space), this yields the Lagrangian subbundle 

d'^P 

K{x) = {{6x,p) \ p =-^{x)6x} (30) 

Such Lagrangian subbundles will be called integrable La¬ 
grangian subbundles. Local integrability of Lagrangian sub¬ 
bundles can be characterized as follows. A Lagrangian 
subbundle K{x) = {{Sx,p) \ p = n(a;)fe} is integrable 
if and only if there exists a function P : A” R such that 

, , d'^P , , 

’^ijix) = = ,n ( 31 ) 


A necessary and sufficient condition for the local existence 
of such a function P is the integrability condition (see [ 8 ] 
for the same condition in the characterization of Hessian 
Riemannian metrics) 


diTjk 

dxi 


{x) 


dTTjk 

dxj 


(x), 


fj,k = I,-- - ,n 


(32) 


Indeed, (l3^ guarantees the local existence of functions pk (x) 
such that TTjk{x) — ^r{x),j,k = I,-- - ,n. Then by 
symmetry of H 


^(x) = ■Xjkix) = TVkj{z) = ©fc = lu • • ,ri 

(33) 

which is the integrability condition guaranteeing the local 
existence of a function P{x) satisfying 


Pjix) = -^ix), j = l,---,n (34) 

By differentiation of (l34l i with respect to Xi and in view of 
the definition of pj{x),j = 1 , • • • ,n, this amounts to (OTT l. 

Now consider a Lagrangian subbundle K of TX (B T* X 
which is invariant for the system ( i25b . i.e., by Proposition 
|4]2] © Xhj - J2jLi 9j ® is tangent to /C and 

K is invariant for pj, j = 1,..., m. 

Additionally assume that the projection of K{x) C T^X® 
T*X on TxX is equal to the whole tangent space T^X for 
all X G X. Then in any set of local coordinates x^■ ,x'^ 
for X the Lagrangian subbundle K is spanned by pairs of 
vector fields and one-forms 

t ^ I ■ 1 

^= I,--- ,n 

where the one-forms 


V{x)U'^{x) = U{x)V'^{x),i:a.nk[U{x) U(a;)] = n} 

(29) 

with U{x),V{x) n X n matrices depending on x, are La¬ 
grangian. 

An important special class of Lagrangian subbundles is 
defined as follows. Let N C T*X be a Lagrangian subman¬ 
ifold, given as N = {{x,p) G T*X \ p = ^^{x)} for some 
(generating) function P : A” ^ R. Then tangent vectors to 
N at a point {x,p) G N are vectors (Ar(a;), a(a;)) G 


TTlix) = •Kii{x)dx^ + • ■ • 'ITni{x)dx^, i = 1, • • • ,n 

satisfy, because of the fact that K is Lagrangian, the sym¬ 
metry property 

Trji(x) = Tr^j(x), i,j = l,---,n 

Defining the n x n symmetric matrix n(a;) with (i,j)-th 
element tt^ it immediately follows, cf. (| 2 ]) and Q, that 
invariance of K with respect to the system (125]) amounts to 






the coordinate expression (/‘^©X^/ — 9]®h^jXhy. 
is tangent to /C) 

(fj)^(a^)n(a^) + n(a;)|^(a;) - U{x)g{x)g^{x)U{x) 

+(ir(^)i(^) + ^(^)/(^)=o, 

together with (K is invariant for gj,j = 1,... ,m) 

(^)^(^)n(a;) +n(a;)^(a:) + ^{x)gj{x) = 0, 

(36) 

j = !,■■■ ,m 

The equation dTSl l is called in [14] the (generalized) dijfer- 
ential Riccati equation. 

Remark 5.3: Note that the equation (l36T l is not present in 
[14] since in that paper throughout the assumption is made 
(continuing upon similar assumptions in [19], [20]) that the 
vector fields gj are independent of x (that is, constant in the 
chosen local coordinates x) and furthermore that ^{x)gj = 
0, j = 1, • • ■ , m. In that case (13^ is trivially satisfied. 

Remark 5.4: In [14] it is proved, analogousy to the linear 
case (i28T l. that an n-dimensional subbundle K which is 
invariant with respect to /'^ © Xfjf — 

and has eigenvectors in the left-half of the complex plane is 
necessarily Lagrangian. 

Remark 5.5: Another connection is to the work on state- 
dependent Riccati equations; see, e.g., [2] and the references 
quoted therein. 


VI. Differential Lyapunov equations 

Differential Lyapunov equations correspond to the case 
where gj = 0, j = 1, ■■■ ,m, for the system E (no inputs), 
and the interconnection of the resulting prolongation 5E and 
Hamiltonian extension dE reduces to du — Sy. (Notice 
that the variational inputs 6u and adjoint variational outputs 
dy are absent.) This leads to the simplified differential 
Hamiltonian system (compare with (i25T l) 

i = 

Vj = hj{x), j = l,...,m, 

while the differential Riccati equation dTSl l simplifies to 

(fj)^(2^)n(a^) +n(x)f|(a:) 

(38) 

and (l36l) is void. This is nothing else than the standard type 
of equation considered in contraction analysis [18], [12]. 

On the other hand, an extension of the differential Hamil¬ 
tonian system (i25l) concerns the differential version of the 
state feedback Hoo problem (see, e.g., [20], [23]), in which 
case there are, next to the input vector fields gj,j = 
1, • • • ,m, additional disturbance vector fields. This relates 
to previous work on differential L 2 -gain; see [20], [25]. 

VII. Conclusions and outlook 

We have described a geometric framework for defining 
differential Hamiltonian systems and (generalized) differen¬ 
tial Riccati equations. This already enabled the consideration 


of arbitrary input vector fields. The precise implications of 
this framework are yet to be seen, which is a topic of 
current research. In particular, the notions of ’integrability’ of 
differential Hamiltonian systems and Riccati equations need 
further study, as well as the implications towards properties 
of incremental stabilizability, see, e.g., [19], [10], [14]. 
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